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Summary of Results 


In this report, we analyze the performance of several high rate 
convolutional inner code/RS outer code concatenated coding systems for 
possible use in NASA's high speed digital satellite comnunication systems. 
Three types of inner codes are considered: 

1) Rate (n-l)/n, n>3, punctured convolutional codes which produce a 
total effective information rate between 0.5 and 1 bits per unit 
bandwidth. Punctured codes are decoded using the same decoding 
trellis as NASA's standard rate 1/2 inner codes. However some parity 
bits are deleted, resulting in a higher effective rate. This causes 
some trellis branches to contain two bits (one information and one 
parity), while other branches contain only one information bit, and 
may cause problems in properly synchronizing the decoder. 

2) High rate majority-logic decodable convolutional codes. These codes 
also produce an effective information rate between 0.5 and 1 bits per 
unit bandwidth, and the decoders are simple and capable of high speed 
operation. However, performance falls far short of what can be 
achieved with Viterbi decoding. 

3) Bandwidth efficient trellis codes using MPSK modulation which achieve 
effective information rates greater than 1 bit per unit bandwidth. 
These codes can make use of soft decision Viterbi decoding to achieve 
significant coding gains on bandlimited channels. 

Two decoding schemes are considered. Scheme 1 is a concatenated coding 
system without side information. The received sequence is first decoded by 
the inner decoder using the conventional Viterbi algorithm. The outputs of 
the inner decoder are then grouped into bytes, deinterleaved, and decoded by 
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an outer errors-only RS decoder. Our results indicate that coding gains from 
5 to 8 dB can be achieved at decoded BER's of 10“^ to 10 - ^ with little or no 
bandwidth expansion. For example, with a 64-state punctured inner code and an 
overall code rate of 0.75,. coding gains of 7.75 dB @ 10“^ and 5.05 dB @ 10"^ 
are achievable. With a 4-state bandwidth efficient inner code, 8-PSK 
modulation, and an overall code rate of 1.0, coding gains of 7.15 dB @ 10“^, 
and 5.05 dB @ 10“^ are achievable. This 4-state decoder is capable of high 
speed operation. 

Scheme 2 is a concatenated coding system with side information. The 
received sequence is first decoded by the inner decoder with a modified 
Viterbi algorithm. In this modified algorithm, "path metric" comparisons are 
used to estimate the entire information sequence and "branch metric" 
comparisons are used to provide side information on the estimated sequence. 
This is done by erasing the estimated bits that are probably in error. The 
outputs of the inner decoder are then grouped into bytes, deinterleaved, and 
decoded by an outer errors-and-er asur es RS decoder. If the erasure-correcting 
capability of the outer code is exceeded, the block is erased. Our results 
indicate that extremely low undetected bit error rates (BER's) can be achieved 
with only moderate erasure probabilities at signal-to-noise ratios near 5dB 
and with little or no bandwidth expansion. For example, undetected BER's as 
low as 10”^, with an erasure rate no more than 10“^, can be achieved with a 
64-state punctured inner code with overall code rate 0.765 at an E^/Nq of 5.35 
dB or with a 16-state bandwidth efficient inner code, 8-PSK modulation, and an 
overall code rate 0.9 at an E^/Nq of 5.45 dB. The 16-state decoder would be a 
factor of 4 faster than the 64-state decoder. 
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Abstract 

In this paper, we consider high rate concatenated coding systems with 
trellis inner codes and Reed-Solomon (RS) outer codes for application in 
satellite communication systems. Two types of inner codes are studied. 

1) High rate punctured binary convolutional codes which result in overall 
effective information rates between 1/2 and 1 bit per channel use; 

2) Bandwidth efficient signal space trellis codes which can achieve 
overall effective information rates greater than 1 bit per channel use. 

Channel capacity calculations with and without side information are 
carried out for the concatenated coding system. It i3 shown that, for 
moderate values of constraint length, optimal performance is obtained by 
choosing the inner code rate near inner channel cutoff rate. 

Two concatenated coding schemes are investigated. In Scheme I, the inner 
code is decoded with the Viterbi algorithm and the outer RS code performs 
error-correction only (decoding without side information). In scheme II, the 
inner code is decoded with a modified Viterbi algorithm which produces 
reliability information along with the decoded output. In this algorithm, 
path metrics are used to estimate the entire information sequence, while 
branch metrics are used to provide the reliability information on the decoded 
sequence. This information is used to erase unreliable bits in the decoded 
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output. An errors-and-erasures RS decoder is then used for the jouter code. 
These two schemes are proposed for use on NASA satellite channels. Our 
results indicate that high system reliability can be achieved with little or 
no bandwidth expansion. 
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1. Introduction 

Concatenated coding has long been used as a practical means of achieving 
reliable communication over satellite channels [1,2,3]. One such system 
consists of Viterbi decoding of an (n,l,m) convolutional inner code 
concatenated with an outer Reed-Solomon (RS) code. The overall effective 
information transmission rate of this system is less than 1/n, n >_ 2, bits per 
channel use [2,3]. This system achieves increased power efficiency for 
/ decreased bandwidth efficiency. With the ever-increasing demand for satellite 

communication services, both available channel bandwidth and transmitter power 
must be conserved. Thus, the search for bandwidth and power-efficient 
modulation/coding systems has recently become a very active research area. 

In this paper, we present a trellis code/RS code concatenated coding 
system for use in high speed satellite communication systems. Two types of 
trellis codes are considered: 

1) High rate punctured binary convolutional codes with code rates 

(n-l)/n, n^3 [4,5]. 

2) Bandwidth efficient signal space trellis codes with effective code 
rates of 1 or greater [6, 7, 8, 9], 

The advantage of using punctured codes is that decoding is simplified, 
especially if the decoder must be capable of decoding rate 1/n and rate k/n 
codes. With rate (n-l)/n, n^ 3, punctured codes as inner codes, an overall 
effective information rate greater than 1/2 but less 1 bit per channel use can 
be achieved. The goal of using bandwidth efficient signal space trellis codes 
as inner codes is to achieve overall effective information rates around 1 bit 
per channel use. As we will see in the following sections, such a system can 
provide a rather large coding gain at bit error rates (BER's) of 10”^ " 10~9 
with no bandwidth expansion. 


3 



1 


Fig. 1 shows the encoding-decoding block diagram of the concatenated 
coding system. Encoding is performed in two stages. An information sequence 
of Kb bits is divided into K bytes of b bits each, and each b-bit byte is 
regarded as a symbol in GF(2^). These K bytes are used as the input to the RS 
encoder. The output of this encoder is an N-byte codeword which is 
byte-interleaved and then serially encoded by the trellis encoder. Decoding 
is accomplished in the reverse order. The output of the maximum-liklihood 
(Viterbi) trellis decoder contains bursty errors. The main purpose of the 
inner code is to shape the distribution of the errors on the inner channel, 
rather than to correct errors, particularly when the inner code rate is around 
the cutoff rate of the inner channel. When an RS outer code is used, this 
shaping compresses the random errors on the inner channel into symbol errors 
corresponding to the symbol size used by the outer code [10]. The use of , 
bandwidth efficient signal space trellis codes as inner codes has one 
important feature: because of the bandwidth efficient property of the code, it 
compensates for the bandwidth expansion introduced by the outer RS code, so 
that the overall system suffers no bandwidth expansion. 

The organization of the paper is as follows. In section II, the outer 
channel is modeled as a block interference (Bl) channel [11], We then 
calculate the channel capacity of the outer channel both with and without side 
information. This calculation shows that: 

1) Concatenated code performance (in terms of outer channel capacity) is. 
optimized at a certain inner code rate, denoted by Ri°P c . The value of Ri°Pt 
depends on the inner code constraint length, it increases as the constraint 
length increases, and it approaches the inner channel capacity as the 
constraint length goes to infinity. For moderate constraint lengths, Rj 0 Pt is 
close to the inner channel cutoff rate. 
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2) For a given inner ' code constraint length, there exists a limit onthe 
inner code rate, denoted by R]® ax , beyond which coding becomes useless (the 
outer channel capacity goes to zero). 

3) As the inner code rate increases from Ri°P c to Ri max , system 
performance (outer channel capacity) degrades rapidly. This helps explain the 
steep BER curves of concatenated codes. 

In sections III - V we study two concatenated coding schemes. Scheme I, 
a Viterbi decoded trellis inner code/RS outer code system, where the Viterbi 
decoder outputs (without side information) are provided to the outer decoder, 
is studied in section III. A modified Viterbi decoding algorithm for trellis 
codes with output reliability information is presented in section IV; Scheme 
II, a concatenated coding system with side information available to the outer 
decoder, is then studied in section V. In the modified algorithm, path 
metrics are used to estimate the entire information sequence, and branch 
..metrics are used to provide reliability information on the decoded sequence. 
This is done by erasing a certain number of bits on the survivor of a 
comparison between the two most likely paths whose metrics are within some 
preset threshold of each other. Finally, in section VI, we summarize our 
results and draw some conclusions which are useful in the design of 
concatenated coding systems. 
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II v Channel Capacity Calculations - — - - - 

We assume the inner channel to be a discrete memoryless channel (DMC). 
After decoding the inner code, however, the outer channel (the channel seen by 
the outer decoder) is no longer a memory less channel. It has been transformed 
into a nonuniform or time varying channel by the inner decoder. In this 
section, we will consider the outer channel formed by the byte interleaver, 
inner encoder, inner channel, inner decoder, and byte deinterleaver, as shown 
in Fig. 1. We assume that an (n,k,m) convolutional code is used as the inner 
code. We first show that this outer channel can be model as a BI channel 
[11]. It has been argued that channel capacity is the best measure of system 
performance, whereas cutoff rate is an inverse measure of decoding delay [11]. 
This observation is further supported by noting (from (3.7) and (4.17) in [11]) 
that channel capacity is additive while cutoff rate is not for BI channels 
with side information. Therefore, to assess concatenated code performance, 
we will calculate the channel capacity of the outer channel. 

It has been shown that [12], for any DMC, there exists an (n,k,m) 
time-varying convolutional code for which the probability of an event error of 
length j + m branches with maximum-likelihood decoding is upper bounded by 

Pj(i,p) < [ (a^-Da^i -1 )k] P 2-Cm+ j)lcE 0 (_q, p ) / R 1 , 

for 0 < Ri < Ci, 0 £ p < 1, j = 1,2,..., (1) 

where R^= k/n is the inner code rate, Cj is the inner channel capacity, and 


E o(iL>p) = ~log2 E[ Eq(x)p(y| X ) 1 ^ 1+ P^ ] 1+ P. 

y x 


( 2 ) 
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Since in -a j + m-branch- error -event the last m-k^bit information tuples 

must be correct for the incorrect path to remerge with the correct path, the 

A 

error burst is confined to the first m(j) = jk bits of the error event. When 

a code with symbols over GF(2^),b 2, is used as the outer code, a j+m-branch 

A 

error event can cause up to t(j) = fm(j)/bl + 1 symbol errors, where txl 
denotes the integer greater than or equal to x. Hence, the symbol error 
probability in the outer channel can be upper bounded by 


P a Cg_,p) < E t(j) P; (£,p) 

j-l 


j-l Q 

< E t(j) ((2 k -l)2 k ^j“D) 2“( M+m O))Eo^,P>/R 1 

i-i 


. r ( — ♦ 2) ( <2^l)2k<j-l>)V<M*tO>eo<q,P>/Ri, 

j-J 0 ' 


for 0 < Ri < Cl, 0 < p < 1, (3) 

A 

where J, 1<J<°°, is arbitrary and v = mk is the encoding constraint length*. 
Let the second term on the right hand side of (3) be denoted by Q(g_, p). 

Then 

Q0g.,p) = ( 2 k -l) P 2 -( v+k >E 0 (_q,p)/R 1 {£ — 2 k P(j"l > 2 -k( j-l )E 0 (g., p) /Ri 

j=J b “ "*■ 


+ E 2*2 k P(j _ l)2 _k ^ j“l)Eo^» p ^ R i ^ 

j"J 

= (2 k -l) P 2-( v+k > E o ( l»P )/R i {“ E j z j -1 +2 E zJ-1}, (4) 

b 

where z 18 2 k P2 _kE Q(^> p) /R j . To obtain a closed form expression for 

*For simplicity, we assume that each encoder shift register 
has full length m. 
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Q(£, p), note that 


= , |z| < 1. 

j=J 1-2 


and by taking the derivative of both sides we obtain 


E jzi“l 


— ( e z3) - — C f — ) = 77 — T 

dz j=j dz 1-z (1-z) 


2 + 


Jz J ~l 

1-z 


z | < 1 . 


After some manipulation, (4) can now be rewritten as 

, p . , kJ x wz-1 k w 

Q( A ,p) - <2k-l) { ( — + 2) ♦ - ~ 

b 1-z b ( l-z)2 


}, 0 < p Eo(^, p)/Rl <, 1, 

(5) 


A 

where w = 


2kpJ 2~( v + k)Eg(q,p)/Rj^ 


Substituting (5) into (3) and minimizing P s (j^, p) over ^ and p, we obtain the 
following closed form expression for the symbol error probability: 


P s < min i E tCj) ((2^-l)2k(j-l)) P 2-( v+ra ^)> E o ( l»P )/R i + Q(a,p)>, 

q. j=l 

0<p<l 

0 < R X < Ci. (6) 


Due to the interleaving, symbol errors in the outer channel are 
statistically independent, and hence the outer channel is equivalent to a BI 
channel with two memoryless BSC's, as shown in Fig. 2. Channel Aq is a noise- 
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less BSC, and A 172 , assuming the worst case, is a useless BSC with crossover 
probability 1/2. A sequence of b consecutive bits is sent over Aq with 
probability Pr{Ag} = 1 - P 8 and over b\[2 with probability Pr{Ai/ 2 ) = P s . 

The outer channel capacity with and without side information is given by 

[ 11 ] 

C 2 - 1 - Ps (7) 

and 

C 2 = (l~p) - “ (H(p) + p log 2 (l-2“^)}, ( 8 ) 

b 

A 

respectively, where p = P s (l-2 -b ) and H(p) is the binary entropy function. 

Then the overall channel capacity of the concatenated coding system is 

C = C 2 • Ri (with side information) (9) 

and 

C - C 2 • Rj. (without side information) (10) 

Note that the capacity without side information approaches the capacity 
with side information as b increases, but the rate of convergence is slow 
(o(l/b) convergence). Also, from ( 6 ) we see that P g is a decreasing function 
of b; therefore, both C and C increase as b increases. 

To obtain some numerical results, assume the inner channel is a BSC with 
crossover probability e =0.1. Fig. 3 shows the overall channel capacity of 
the concatenated coding system, normalized by the inner channel capacity Ci, 
for k=3 and b= 8 , with v as a parameter. For fixed v, there is an optimum 
value of Ri/Gi that maximizes the overall capacity. We denote the correspond- 
ing inner code rate by Ri°P c (Ri°P c ). Note that the optimum inner code rate 
does not occur at the value of Ri which presents the best (least noisy) 


9 



channel.to the. outer, decoder. Instead, . there is a local -maximum for each — .... 

value of v that drifts towards the higher rates as v increases. This is 
reasonable since the system performance should improve for increasing 
contraint length. For moderate values of v, R 2 °P t (Ri°P t ) is close to the 
inner channel cutoff rate. In addition, for a fixed v, there is a limit on 
Rj, denoted by Ri max (R^max) , beyond which the overall capacity goes to zero 
(for v=3, Ri max =0.60Ci and Ri max =0 . 58Ci ) . Therefore, the inner code rate is 
constrained between 0 and Ri max (R^ max ) . In fact, in a concatenated coding 
system, the inner code rate often lies between Ri°P t (Riopt) and R^ max 
(R^max). The rapid increase in overall capacity as Rj goes from R^max(R^max) 
to Rj°P t (Ri°P t ) corresponds to the sharp decrease in BER with increasing 
signal power (and hence Cj) in well designed concatenated coding systems. 


III. Coding Scheme I - Without Side Information 

A concatenated coding system is depicted in Fig. 1. Decoding is 
accomplished in the reverse order of encoding. The inner decoder uses the 
Viterbi algorithm. The outputs of the inner decoder (without side 
information) are grouped into b-bit symbols. Because the lengths of the 
bursts of output errors made by the Viterbi decoder are widely distributed, 
b-bit symbol deinterleaving is used so that errors in the individual 
RS-symbols of one block (N symbols) are independent; otherwise, a very long 
block code would be required to operate the system efficiently. 

Let the minimum distance of the (N,K) RS code be d 2 . When an N-symbol 

block is received by the outer decoder, it performs errors - only decoding. 

. . id2“l | 

That is, if the N-symbol block contains t 2 =1— or fewer errors, the errors 
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are corrected; otherwise, decoding fails. t 2 is called the error-correct ing- 
capability of the (N,K) RS code [13]. The decoded bit error rate at the 
output of outer decoder can be closely approximated by 
do 00 N ... 

P b =7 e i (p s ) x (i-p s ) n_1 . (ID 

2N i=t 2 +l 

where P s is the symbol error probability into the outer decoder. 

In this section, we give several examples of the Scheme I concatenated 
coding system. For each example, we use RS codes with symbols over GF(2®) 
and N=255. The symbol error probability P s is obtained by computer simulation 
on an AWGN channel unless otherwise noted, and (11) is used to estimate the 
final decoded BER. 

A. Examples with inner punctured codes 
Example 3.1 : 

The best punctured rate Ri = 3/4, 5/6, and 7/8 codes that are formed from 
the basic (2,1,6) convolutional code [5] are used as inner codes. Decoding is 
by the Viterbi algorithm with 3-bit quantization. The decoded BER Pfc vs. 

Ejj/No is shown in Figs. 4.1 - 4.3 for 3 different RS code minimum distances. 

% 

Fig. 4.4 shows the Efc/No required to achieve- decoded BERs of 10~6 and 10“9 as 
a function of the overall code rate R. Note that, for the given decoded BERs 
and a given R, lower inner code rates gives better performance. From Fig. 

4.4, we see that the best performance is obtained at R = 0.65 for Rj = 3/4, 
and at R = 0.73 for Rj = 5/6 and 7/8. These curves indicate the existence of 
an optimum outer code rate, i.e., the outer code rate which minimizes the 
required Ejj/Nq to achieve a given decoded BER for a fixed inner code rate. 
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Fig. 4.5 shows system performance for the case Rj = 3/4, R = 0.656, and d 2 = 

33 vs. R^/Roi- As Ri/Roi goes to 1 (the channel becomes noisier), system 

performance degrades rapidly. This corresponds to the rapid decrease in over- 
all capacity with increasing Rj illustrated in Fig. 3. 

B. Examples with inner bandwidth efficient trellis codes 

The goal of using bandwidth efficient trellis codes as inner codes is to 

achieve a moderate coding gain with no bandwidth expansion. Currently, QPSK 
is the prevalent modulation scheme in use for digital satellite communica- 
tions. To improve power efficiency, error-correcting codes have been 
employed. Because extra bits must be added to the information sequence to 
perform the error correction, the modulator must operate at a higher rate, 
thus requiring a larger bandwidth. On the other hand, if bandwidth is limited 
and the modulator must operate at the same rate as in the uncoded case, the 
information transmission rate is lowered. To improve power efficiency and 
maintain a high rate of information transmission without bandwidth expansion, 
coded modulation, or bandwidth efficient coding, in which trellis codes are 
combined with an expanded set of modulation signals (typically 8-PSK or 
16-PSK), provides an exciting alternative. 

In our concatenated coding system, bandwidth efficient inner trellis 
codes have two functions: 

1) To compensate for the bandwidth expansion introduced by the outer RS 

code; 

2) To compress the random errors on the inner channel into symbol errors 
which can be corrected by byte-error-correcting codes, such as RS codes. 

This concatenated coding scheme performs well on channels which are both power 
and bandwidth limited, as shown in the following examples. 
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Example 3.2 


Periodically time-varying trellis codes (PTVTC) of rate Rj = (2P + i)/3P, 

P > 2, 1 < i < P, are used as inner codes with 8-PSK modulation [7]. These 

codes are especially designed for high data rate channels with low decoding 

complexity. This PTVTC/8-PSK system has an effective information rate 
(1) 3 (2P + i) 

R e ff s* — Rj = > 1 bits/channel use, so it is possible to 


achieve an overall effective information rate R e ff equal to 1 bit/channel use 

or greater. Moreover, because of the periodic property of the code, its 

trellis structure is the same as the trellis structure of a lower-rate code, 

and as a result the complexity of the decoder is reduced significantly [7]. 

The PTVTC 1 s are decoded by the Viterbi algorithm assuming no demodulator 

output quantization. Figs. 5.1 - 5.3 show the decoded BER Pb vs. Eb/No for 

concatenated codes with 4-state inner codes and 3 different RS outer codes; 

Figs. 5.4 - 5.6 give similar results for 16-state inner codes. In Figs. 5.7 - 

5.8 we show the required Eb/No to achieve decoded BERs lO - ^ and 10~9 for 

4-state and 16-state inner codes, respectively. 

Note that at high effective code rates, e.g., R e ff = 1 bit/channel use, 

7 

we still get large coding gains. For example, with a 16-state, Ri = ~ PTVTC, 


the coding gain equals 3.92 dB at Pb = 10 “^ and 6.18 dB at Pb = 10 ” 9 . Even 

7 * 
for a 4-state, Rj = — PTVTC, coding gains of 3.68 dB and 5.98 dB at Pb = 10 _t> 

and Pb = 10~9, respectively, can be obtained. Only a small increment in 

coding gain is achieved as the number of trellis states increases. As the 

number of states goes from 4 to 16, only about 0.2 dB more gain is obtained. 

This appears to be a characteristic of coded modulation in general [6], We 

will see this more clearly when we derive the asymptotic coding gain. 
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Example 3.3 


Ongerboeck's 16-state, rate Ri = 2/3 convolutional code with 8-PSK 
modulation is used as the inner code. This code has an effective information 

(O ... 

rate R e ff = 1 bit/channel use. Therefore, the overall effective information 
rate, R e ff» of the concatenated coding system is less than 1. Again, the 
inner code is decoded by the Viterbi algorithm without demodulator output 
quantization. The final decoded bit error probability P^ is shown in Fig. 6.1 
for 2 different RS outer codes. Fig. 6.2 shows the required E^/No to achieve 

A 

Pb = 10“6 and 10“9. At P^ = 10“^ and 10 "^ coding gains of 4.96 dB and 
7.25 dB can be obtained with only 12.5% bandwidth expansion. 


Example 3.4 

In this example, two kinds of trellis codes are used as inner codes. 

The first kind uses 8-PSK modulation twice per trellis interval (forming a 

64-ary set), and this set is then coded with a R^ = 5/6 trellis code [8]. 

Viewed more generally, code symbols are mapped onto a four-dimensional signal 

set (8PSK x 8PSK) with 5 information bits for every two 8-PSK signals. Thus 

(1) 5 

the effective information rate is R e ff = — ** 1.25 bits/channel use. The 


second kind uses rate R]^ = 3/4 convolutional codes with 16-PSK modulation 

(1) 3 

[9]. The effective information rate is R P ff = — =1.5 bits/channel use. 

4 


This code is more bandwidth efficient than the R^ = 5/6, 8-PSK code, but it is 
less power efficient. 

Let df, E s , and A be the normalized minimum Euclidean free distance, the 
energy per modulation symbol, and the number of nonzero information bits in 
the set of error events at distance df from the correct path, respectively. 
Then at high signal-to-noise ratios, the bit error probability at the Viterbi 
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decoder output is approximated by 


A 

e * — Q 




d f 2 E g R 2 A A 

17T )= 7 q(i 


Pf 2 (J/2)E b R2 , * ,, 

) =7^ 


df 2 l .25E b R 2 


2N 0 


NO 


), 


( 12 . 1 ) 


for Rj = 5/6 and 8-PSK, 


and 


e = 


A n r| df2EsR2 ■ 

J A n rl 

d f 2 (3E b )R 2 

\ A , |d f 2 1.5 E b R 2 

3 Q 1 2N 0 

1 - 3 ,t 'l 

2Nq 

)= 7 Q( V » 0 


( 12 . 2 ) 


for Ri = 3/4 and 16-PSK, 


where R 2 is the outer RS code rate. The RS-symbol (over GF(2* 5 )) error proba- 
bility at the output of the Viterbi decoder is bounded by 

P 3 £ be. (13) 

The final decoded bit error probability P b , obtained from (12.1), (12.2), 

(13), and (11), is shown in Figs. 7.1 - 7.4, where we have chosen the outer RS 
code rate R 2 such that the overall effective information rate R e ff = 1 bit/ 
channel use. Tables 1.1 and 1.2 list the coding gains at P b = 10"^ and 10~9 
for the R^ = 5/6, 8-PSK and Rj = 3/4, 16-PSK inner codes, respectively. In 
both cases, the relatively poor performance of the 8-state and 16-state codes 
compared to the 4-state codes is due to a large number of minimum free 
distance paths. 


Example 3,5 

In this example, we use high-rate self orthogonal convolutional codes 
with majority-logic decoding as inner codes. These codes have the advantage 
of an extremely simple and fast inner decoder. Assuming the inner channel to 
be a BSC with crossover probability p, the BER of the inner decoder output for 
a self-orthogonal (n,k,ra) convolutional code is bounded by 


./ 
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(14) 


e 



**E / n E \ i , . » °E *■ 

E ( P (1-P) 

i=tML + l 1 


where 


P 



(15) 


for BPSK or QPSK modulation on an AWGN channel, n^ is the effective constraint 
length and tj^ is the majority-logic error correcting capability of the code 
[13]. Using (14), (15), (13), and (11), the final decoded BER is shown in 
Figs. 8.1 and 8.2 for rate R^ = 3/4 and 4/5 self-orthogonal inner convolu- 
tional codes, respectively. Three different values of tj^, are considered 
in each case. Although these codes have implementation advantages, their 
performance is clearly much worse than the punctured codes with Viterbi 
decoding. 


C. Asymptotic concatenated coding gain 

Having studied the performance of concatenated coding systems for small 
and medium values of Eb/Ng, it is interesting to look at how the systems 
perform at large values of Eb/Ng - the asymptotic coding gain . This approach 
also gives us some insight into concatenated coding system design. 

We will use BPSK or QPSK as our reference system in the coding gain cal- 
culation. When uncoded BPSK or QPSK is used on an AWGN channel with coherent 
demodulation, the demodulator output BER is given by 

P b = Q(J^ ) = - e " E b /N 0 , for large — • (16) 

1 Ng 2 Ng 
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1 ) Asymptotic coding gain with punctured inner codes . 

Let A be the number of nonzero information bits on all weight df paths 
for an (n,k,ra) convolutional code. If BPSK or QPSK modulation is used, the 
free Euclidean distance df normalized by E s , the symbol energy at the modu- 
lator output, is related to the free Hamming distance df(R) by 

df 2 = 4df (H) , for BPSK, (17.1) 

df 2 = 2df ( h) , for QPSK. <17.2) 


At high signal-to-noise ratios with either BPSK or QPSK modulation, an 
asymptotically tight expression for the bit error probability at the output 
of a Viterbi decoder without demodulator output quantization is* 


2N 0 

_A d f (H)RE b 
2k e“ N 0 


A rl d f 2RE S , A ,f2d f (H)RE b N 
S ) = k Ql | % } 


(18) 


where R = RfR 2 , Rl = k/n is the inner convolutional code rate, and R 2 = K/N 
is the outer (N,K) RS code rate with symbols over GF(2^). From (18), (13), 
and (11), the final decoded bit error probability P b of the concatenated 
coding system can be approximated by 


d 2 


t„ + l 


\N _ t„-l 


p b 2 ~T~ / N \ p c 2 1 (1-P ) W ” C 2* 
N \t 2 +l./ s 3 


d 2 d 2 Ab c 2 +1 df(H)RE b (t 2 -»-l) 

» (t 2 +l) p s t2+1 2 N (t 2 +l) 2k e" N 0 


(19) 


* For QPSK modulation, E s = 2E b since there are 2 bits transmitted per symbol, 
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Comparing (16) to (19), we see that for a fixed E^/No* c ^ e (negative) exponent 
with concatenated coding is larger by a factor of df(H)R(t2 + D than the 
exponent without coding. Since the exponential terra dominates the error 
probability expressions for large E^/Nq, we define the asymptotic coding gain 
as 

A 

y = 10 logig df (H)R( t2 + l ) • (without demodulator output quantization) 

( 20 . 1 ) 

If hard quantized demodulator outputs are used at the input of the Viterbi 
decoder, it can be shown that 

d f (H)R(t2+l) 

y = 10 log^g . (with demodulator output quantization) 

2 ( 20 . 2 ) 


For RS codes, N - K = 2t2 and 


N-K _ _ 2t2 

N N 


( 21 ) 


Substituting (21) into (20.1) and (20.2), the asymptotic coding gain can be 
rewritten as 


, x /n(i-r 2 ) \ 

Y = 10 logio df(H)RiR2^ " + lj 


, . /N( 1-R2 ) - \ , . 

= 10 login df(H)Ri + 10 login R 2l + 1) » (without quantization) 

' 2 ' ( 22 . 1 ) 


and 


Y = 10 logio 


d 2 (H)Rx /N(l-R 2 ) \ 

— — +10 logio ^2^ + lj, (with quantization) 


( 22 . 2 ) 


where the first term is due to the inner convolutional code and the second 
terra depends on the RS outer code. This implies that, for very large E 5 /N 0 , 
the inner and the outer codes in a concatenated coding system can be designed 
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independently of each other. 

Taking derivatives of y with respect to R 2 , the maximum coding gain is 

achieved at R 2 = ~ + - for a fixed inner code, and 
2 N 

Y =10 logio df(H)Ri + 10 logio — + 1 + ~ ) (without quantization) 

max 2 \ 4 N/ (23.1) 

and 

d f (H)Ri 1 / N 1 \ 

Y =10 logio ~ t + 10 logio — { — ’ + 1 + — I . (with quantization) 

max 2 2\4 N / (23.2) 

Fig. 9 shows the asymptotic coding gain without demodulator output quantiza- 
tion, where we use Ri = (n-l)/n, n > 3, punctured convolutional codes formed 
from the (2,1,6) convolutional code as inner codes and an RS code with N = 255 
and symbols over GF(2^) as the outer code. Note that, at high overall code 
rates, higher inner code rates outperform lower inner code rates, which is in 
contrast to the case when E^/Ng is small. The important fact is that system 
performance is very sensitive when the outer code rate R 2 is high. A small 
increase in R 2 results in a large system performance degradation. This is 
also true for small values of E^/Ng, as shown in Figures 4.1 - 4.3. 

2) Asymptotic coding gain with bandwidth efficient inner codes 

Bandwidth efficient codes have been proposed and extensively investigated 
for high data rate transmission over voiceband telephone channels and 
band-limited satellite channels with power constraints. Although most of the 
previous studies on coded modulation for satellite channels have been focused 
on constant carrier envelope signaling formats such as 8-PSK and 16-PSK 
modulation, applications of coded amplitude modulation to high speed satellite 
communication have also been investigated. However, since constant envelope 
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signals mitigate the non-linear effects of TWT amplifiers and have relatively 
simple high speed modem implementations, coded MPSK modulation is the 
preferred modulation scheme for satellite channels. Hence, in the following 
asymptotic coding gain derivation, we assume that the code is formed from a 
rate Ri = k/n convolutional code in combination with 2^-ary PSK modulation, 


L > 2. 

Let Kg be the symbol energy at the modulator output, df be the Euclidean 

distance normalized by E g , and A be the number of nonzero information bits in 

the set of paths at distance df from the correct path. Then 

E g = R 2 RlLE b , (24) 

and the bit error probability at the output of a Viterbi decoder without 

demodulator output quantiz ation is 

, Jd f 2 R 2 ElLE b 

) - Wq— ) 


£ = AQ 


u 

4 


df 2 E« 


2N, 


2N, 


A _ d f 2 R 2 RiLE b 
= 2 6 4 Nq 


where R^L is the average number of information bits in each modulator output 
symbol. Using (25) and following a similar procedure as in the punctured 
inner code case, we can show that the asymptotic coding gain is given by 


y = 10 log 10 


* 10 logio 


df 2 LRjR 2 (t 2 +1) 

4 

d f 2 2RgffR 2 (t 2 + 1) 
4 


d £ R ef f ^ c 2 + D 

= io logic ;; 


(26) 


where 


(1 ) L 

R eff = “ R 1 


bits/channel use 


(27) 
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is the effective inner code information rate, and 


(i) 

R e ff = R eff R 2 bits/channel use (28) 

is the overall effective information rate of the concatenated coding system. 

If an RS code of length N is used as the outer code, by substituting (21) 


into (26) it follows that 

tn , d f 2R eff /N(l-R 2 ) 
Y = 10 logio ; 




= 10 logio 


d f 2R eff 


/ N( 1-R2 ) \ 

+ 10 logio r 2 — +1 | » 


(29) 


and for a fixed inner code, the maximum coding gain is 

d f 2R eff 


_ . _ 1 /N 1\ . _ 1 1 

Y = 10 logio — + 10 logio - “ + 1 + “ . with R 2 - “ + “ . 

max 2 2 \ 4 N / 2N 


(30) 


Note that in (29) the first term denotes the coding gain due to the bandwidth 
efficient inner code and the second term represents the coding gain 
contributed by the outer code; therefore, for very large Eb/No, the inner and 
outer codes can be designed independently in a concatenated coding system. 
Fig. 10 shows the asymptotic concatenated coding gain y for Example 3.2, Fig. 
11 shows Y for Example 3.3, Fig. 12.1 shows y for Example 3.4 when Ri = 5/6 
coded 8 PSK is used as the inner code, and Fig. 12.2 shows y for Example 3.4 
when Ri= 3/4 coded 16PSK is used as the inner code. 

Before finishing this section, we can draw a number of conclusions from 
the above discussion: 

x . (1) . 

1) For a given overall R e ff» there exists an R e ff which optimizes system 

( 1 ) 

performance; or conversely, for a given R e ff, there exists an optimum 
value of R e ff. 

2) System performance is very sensitive to R 2 at very low and very high 
values of R 2 . 
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3) For small or moderate values of Efc/No, and for a fixed R e ff, a lower 

( 1 ) 

R e ff is preferred as long as the outer code rate R 2 is not too high. 

4) Because df increases slowly as the number of trellis states increases, 
choosing inner codes with a small number of trellis states increases the 
data transmission rate (by reducing the number of decoder computations) 
with only a slight sacrifice in system performance. 

IV. A Modified Viterbi Algorithm 

In section II, we have shown that the overall channel capacity of a 
concatenated coding system with side information is an upper bound on the 
capacity without side information. The difference between the two capacities 
is significant, especially on noisy channels, when the inner code rate is in 
the region from Ri°P c to Ri max . We also pointed out in section II that in a 
concatenated coding system [Ri°P t , Ri max ] is the practically interesting 
region for the inner code rate Rj . Therefore, it is advantageous if the inner 
decoder can provide some kind of reliability information (side information) 
about its estimated output which will aid the outer decoder. In scheme I, 
discussed in section III, the inner code is decoded by the Viterbi algorithm 
and the output of the decoder is a sequence of "hard decisioned" binary 
digits, i.e., no side information is associated with the output. To provide 
side information, it becomes necessary to modify the conventional Viterbi 
algorithm so that soft decisioned outputs are made available to the outer 
decoder. 

Several ideas have been proposed to provide some kind of side information 
with the convolutional decoder outputs. Zeoli [14] proposed a concatenated 
coding system that employs a long constraint length (m = 31) convolutional 
code obtained by annexing a tail to a (3,1,7) convolutional code. The 
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longer code is then decoded by the same Viterbi decoder as the short code, 
with the exception that the information sequence along the best path to each 
state is treated as correct and used to "cancel" the effect of the longer tail 
from the encoded sequence. The tail provides excellent error-detection 
capability once the decoder starts to make mistakes. But the algorithm is 
subject to very serious error propagation and the decoder has to be reset 
frequently. 

Another method of providing reliability information with the decoder 
output is to compute the a posteriori probability of each decoded symbol from 
the decoder being correct [3]. However, the a posteriori probability must be 
computed for each branch using a recursive method and real numbers must also 
be stored. This computation process slows down the decoder, so it is not 
suitable for high speed systems. 

A third alternative is to use the "Viterbi decoding algorithm for 
convolutional codes with repeat request" [15] to extract reliability informa- 
tion from the inner decoder. When all the path metrics at some level of the 
trellis are below a predetermined threshold, the received sequence up to that 
level is erased (instead of being retransmitted). But this approach has two 
major drawbacks: 1) when a long received sequence is erased, this erasure 
information cannot be used by the outer decoder because the number of erasures 
may exceed the erasure correction capability of the outer code; 2) with high 
probability, most of the symbols in the received sequence can be decoded 
correctly and hence should not be erased. 

In the following, we propose a decoding technique based on the Viterbi 
algorithm. It erases only the information symbols that are "probably in 
error", and this erasure procedure does not affect the decoder's selection of 
the most likely path. Therefore, the decoder is still maximum- likelihood. 
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Furthermore, the algorithm is very simple to implement and capable of high 
speed operation. 

As the name suggests, an (n,k,m) trellis code is best described in terms 
of its trellis diagram. In the decoding of trellis codes by the Viterbi 
algorithm, a first-event error is made at an arbitrary level j if the, correct 
path is eliminated for the first time at level j in favor of the incorrect 
path. This is illustrated in Fig. 13. The incorrect path must be some path 
that had previously diverged from the correct path. For the example shown in 
Fig. 13, let 

Ij = ( • • • »V j- 3 , Vj-2, Vj_!, Vj) 

and 

1 j - <•••. v'j-a.v'j-s, v’j-i, v'j) 

represent the correct path and the incorrect path, respectively, where V^ 

(v'i) is the symbol on the ith branch of the correct (incorrect) path, and let 
Ej = (V* j- 3 , v'j-2, V'j-i, V'j) 
represent the 4-branch first-event error at level j. Also let 
Uj = (..., Uj_3, Uj— 2 , Uj_j , Uj) 

and 

U’j = (..., u'j- 3 , u'j-2, U'j-i, U'j) 
represent the information sequences associated with paths Vj and V_ j, 
respectively, where U£ (u'i) is a binary k-tuple, and let 
Ij = (U'j-3, U’j-2, U'j-i, U’j) 

represent the 4-branch information sequence corresponding to the 4-branch 
first-event error Ej at level j. Denote a branch metric by X(V^) and a path 
metric by X(Vj). From Fig. 13 we observe that Ij is unreliable and should be 
erased. This observation motivates us to propose the following decoding 
algorithm. 
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Algorithm 1 : 

For each state at level j, select the path V.' j = (..., v'j_£+i, 

V ' j_£+2 > • • . , v'j) (where i is chosen as the expected error event 

length) that has the largest metric X(v/j) and the path Vj = (..., Vj_£ + j, 
Vj_£+2»***» v j-l« v j) that has the next largest metric X(Vj). Because 
_v'j has the largest metric, V_' j survives at that state. Moreover, if 

A(v'j) > \(Vj) + T (T > 0), (31) 

decoding continues as in the conventional Viterbi algorithm. On the other 
hand, if 

X(v'j) < A(Vj) + T, (32) 

then Ij = (u j -£+i, U ' j-£+2 > • • • , U j-i, ^ j) on the surviving path is 
erased and decoding continues. 

Note that if T = 0, the algorithm reduces to the conventional Viterbi 
algorithm. As an illustration of the algorithm, in Fig. 13, for some state at 
level j, suppose that A(_V j) > X(Vj), so the incorrect path v'j survives. If 

X(v'j) < X(Vj) + T, (33) 

then = (u'j_ 3 , u'j_ 2 , u'j_i, Uj) is erased. Note that (33) is equivalent 
to 

\(v'j_3)+ X(v'j_ 2 )+ X(V ' j-1 ) + X(v'j)< X(V j-3 )+ X(Vj-2)+ X(Vj_i)+ X(Vj)+ T.(34) 
Eq. (34) implies that, if the metrics of the two 4-branch sequences are 
"close" in terras of the threshold T, the corresponding information sequence Ij 
is not reliable, and therefore a tag should be attached to it which indicates 
its degree of reliability. The simplest way of doing this is to erase it. 

From (34) we see that this erasure decision is made on the most recent l 
branches for a £-branch error event, and hence it is a "local" estimate. On 
the other hand, the path estimate is a "global" estimate. From this point of 
view, we see that Algorithm 1 is constructed based on the following ideas. 
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1) By letting the path with the largest path metric survive, we are 
choosing the maximum-likelihood estimate. 

2) By performing a "branch comparison" over the most recent l branches, 
we provide some reliability information on the maximum- likelihood path. 

Because the reliability is estimated over only i branches, the 
reliability estimates are suboptimum. However, in feedback decoding of con- 
volutional codes, decisions are made over only one constraint length. Hence 
we can say that the reliability estimates have a certain degree of precision. 
Ideally, the number of erased k-triples, l, should equal the length of the 
error event. Practically, however, choosing £ equal to the average error 
event length should be sufficient. 

Algorithm 1 can be applied to any trellis code. If, however, the trellis 
is generated by a finite-state machine, the algorithm can be improved. Let m 
and k denote the memory order of the finite-state machine and the number of 
input bits to the finite-state machine. Then trellis codes can be divided 
into two cases of practical interest: 

1) If all k input bits are shifted into memory, there can be no parallel 
transitions in the trellis. Since the last km information bits 
associated with an error event of length l branches must be correct for 
the incorrect path to remerge with the correct path, decoding errors are 
confined to the first £-m branches. 

2) If fewer than k bits are shifted into memory and the remaining bits 
are uncoded, there are parallel transitions between any two connected 
states in the trellis, and all the information bits associated with an 
error event may be in error. 
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In Che case where parallel transitions are possible, we must use 
algorithm 1. However, in decoding trellis codes without parallel transitions, 
a modified algorithm can be used. 

Algorithm 2 . 

For each state at level j (j =m+ 1, m+2,...), select the path 

_V ' j = (..., V ' j— £ — j-I , v'j_£+ 2 , ,v'j) (where £ is chosen as the expected 

error event length) that has the largest metric X(V_ j) and the path 

Vj = (..., Vj_£+i, V j-i+2 , . • • ,Vj ) that has the next largest metric X(Vj). 

Because V_' j has the largest metric, V_' j survives at that state. Then if 

X(v'j) > X(Vj) + T ( T > 0), (35) 

decoding continues as in the conventional Viterbi algorithm. On the other 
hand, if 

X(v'j) < X(Vj) + T, (36) 

then the information symbols u'j_£ + i, U* j-j,+2 ♦ • • • » u *j-m on the surviving path 
are erased and decoding continues. 

In both algorithms, smaller values of T result in lower erasure rates but 
higher error rates, and larger values of T result in higher erasure rates but 
lower error rates. 

V. Coding Scheme II - With Side Information 

The encoding process is the same as in Scheme I. Decoding is done in two 
steps. First, the inner trellis code is decoded by the modified Viterbi 
algorithm presented in the last section. The outputs of the inner decoder 
consist of binary digits as well as erased bits, and they are grouped into 
b-bit bytes, deinter leaved , and sent to the outer decoder. Bytes which 
contain any erased bits are considered as erasures by the outer decoder. 
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Let i be the number of erased symbols in an RS outer codeword of length 
N. The outer decoder declares an erasure (or raises a flag) for the entire 
block of N bytes if i is greater than the erasure-correction threshold T es , 
where 

T e s < < d 2 " 1) (37) 

and d 2 is the minimum distance of the outer (N,K) RS code. If i is less than 
T eg , the outer decoder starts error s-and-erasures decoding on the N-symbol 
block, and the i symbol erasures along with the symbol errors are corrected 
based on the outer code. Let t(i) be the error-correction threshold for a 
given i, where 

t ( i ) < [(d2-i-l)/2j . (38) 

If the syndrome of the N-byte block corresponds to an error pattern of i 
erasures and t(i) or fewer symbol errors, errors-and-erasures correction is 
performed. The values of the erased symbols, and the values and the locations 
of symbol errors, are determined based on a certain algorithm. However, if 
more than t(i) symbol errors are detected, then the outer decoder again 
declares an erasure (or raises a flag) for the entire N-symbol block. 

Let P 3 and P e be the RS-symbol error probability and RS-symbol erasure 
probability at the input of the outer decoder, respectively. The probability 
of correct decoding of a block is given by 

Tes /N\ . t(i)/N-i\ . 

P c - 2 ( . Pe 1 2 P S J (1 - P s - P e )N-i-J , (39) 

i=0 ' i 1 j=0 ' j ' 

where T es and t(i) are defined in (37) and (38). Let Pb e and Py,i denote the 
probabilities of a block erasure and an incorrect decoding, respectively. 

Then 

P C + p be + Pbi = 1, (40) 
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and 


p be + p bi~l~ p c 


T es / N \ . N-i /N-i\ . 

= E ( . Pe 1 ^ . )? a Hl 

i=0 \ W j=t(i)+l V J / 


_p e~ p s ) 


N-i- j 


E (i) Pe i(l-P e )N-i 
i=T es + l 


(41) 


The probability of incorrect decoding of a block is not easy to determine. 
But it can be upper bounded by [16] 

T pq . . N-i 


i es / v . /N-i\ 

p bi < 2 * ( . V<3 

i=0 \ L / j=d2~i-t(i) ' J ' 


l-Ps-Pe)^ 1 '^ , 


(42) 


and the final decoded BER of the concatenated coding system is approximated by 
P b i P bl . (43) 


In the following we consider several examples for Scheme II. The outer 
code is again an RS code of length N = 255. Inner trellis codes are decoded 
by the modified Viterbi algorithm in section IV. We use B to denote the 
number of erased branches in the modified Viterbi algorithm. The RS-symbol 
error probability P s and the RS-symbol erasure probability P e at the input to 
the outer decoder are determined by computer simulation. In decoding the 
outer code, thresholds T es and t, which are independent of the number of 
erased symbols in an N-symbol block, are assumed, and (41) and (42) are 
modified as 
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Tes / N\ . N-i /N-i\ 

Pbe + Pbi = £ U)Pe l £ l j 

i=0 j=min( t ( i ) , t )+i 


P s i < 1 - p e-Ps) N ' i " j 


N /N\ 

+ E U)Pe i (l-Pe) H " i 

* m . 1 


(44) 


i _, Pgg+l 


and 


T es /M\ . N-i /N-i\ . 

Pbi< £ li Pe 1 £ l j )P s 1 (l-Ps-P e ) N " 1 ' J » (45) 

i=0 j=d 2 ~i~min( t( i) , t )' 


where T es < d 2 ~l and t <|( d 2 — 1 ) / 2J- Usually, the probability of a block 
erasure Pbe is much larger than the probability of block decoding error Pbi- 
Therefore, Pb e + Pbi is a tight bound on Pbe* * n the examples below we 
compute the sum of the probability of a block erasure and of a block decoding 
error, Pb e + p bi» and the final decoded BER Pb- 

A. Examples with Punctured Inner Codes 
Example 5.1 : 

The inner codes are the same as in Example 3.1. In decoding the inner 
code, we use Algorithm 2. BPSK or QPSK modulation over an AWGN channel with 
three bit uniform quantization is assumed. The bit metric is given by 

m(l/l ) = log p(l/l), I = 0,1,2,. ..,7, (46) 

when I is received and 1 is transmitted. In the computer simulation, we use 
nonnegative bit metrics by letting 

m(l/l ) = log p(l/l) - log p(0/l), I = 0,1,. ..7, (47.1) 

and by symmetry, 

m(l/0) = m( (7-1) / 1 ) , I = 0,1,. ..,7. 
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(47.2) 
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The branch erasure threshold T in Algorithm 2 is chosen to be 

T = T'm(0/0), (48) 

where T* is a normalized threshold. Figs. 14.1 - 14.3 show the probabilities 
P b and P be + ?bi as a function of t. 

B . Examples with Bandwidth Efficient Inner Codes 

In decoding the bandwidth efficient code we use Euclidean distance as the 
decoding metric. The erasure threshold in the modified Viterbi algorithm is 
chosen to be 

T = (T'd f E b /N 0 ) 2 , (49) 

where df is the Euclidean free distance of the code normalized by the signal 
energy at the demodulator output, and T' is a normalized threshold. 

Example 5.2 : 

As in Example 3.2, the PTVTCs of Rx = (2P + i)/3P, P > 2 and 
1 < i < P, with 8PSK modulation are used as inner codes. Only 16-state codes 
are considered. Because of the parallel transitions in the trellis, algorithm 
1 is used. P b and P be + P b i, with Rj = 7/9, 5/6, 8/9, are shown as functions 
of t in Figs. 15.1, 15.2, and 15.3, respectively. 

Example 5.3 ; 

As in Example 3.3, Ungerboeck's Rj = 2/3 coded 8PSK with 16 trellis 
states is used as the inner code. Because there are no parallel transitions 
in the code trellis, we use algorithm 2 in decoding the inner code. P b and 
P b e + **bi are shown in Fig. 16 as a function of t. 

From the above examples, we see that for a given E b /Ng, the decoded BER 
of Scheme II is significantly lower than that of Scheme I. Scheme II provides 
us with flexibility in the system design. Tradeoffs between the decoded BER 
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and the probability of block erasure can be obtained by varying the error 
correction threshold t of the outer code. Smaller values of t always result 
in lower decoded BER's, but a higher probability of block erasure. In 
practice, given a specified system performance, the values of t can be chosen 
accordingly. 

VI . Summary and Conclusions 

In this paper we considered high rate concatenated coding systems with 
trellis inner codes and RS outer codes for application to satellite communica 
tion systems. Specifically, we considered high rate punctured binary convolu 
tional inner codes, which result in overall effective information rates 
between 1/2 bit and 1 bit per channel use, and bandwidth efficient signal 
space inner codes which can achieve overall effective information rates 
greater than 1 bit per channel use. 

The outer channel in the concatenated coding system was modeled as a BI 
channel, from which we were able to calculate the overall channel capacities 
with and without side information. These calculations revealed that for 
finite total encoder memory order, optimum system performance is achieved at 
an inner code rate R^opt, and as the inner code rate increases beyond Rj°pt, 
system performance degrades sharply. We also showed that system performance 
in terras of channel capacity improves when side information is available. 

Two types of concatenated coding systems were studied. Scheme I operate 
without side information, while Scheme II uses side information. The 
performance of Scheme I was studied by computer simulations, formula 
calculations, and by asymptotic coding gain derivations. Results indicated 
that rather large coding gains could be obtained with little or no bandwidth 
expansion. In studying the performance of Scheme II, we first proposed a 
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modified Viterbi algorithm for decoding trellis codes. Side information was 
provided to the outer decoder in the form of symbol erasures. The outer RS 
code was then decoded by an errors-and-erasures decoder. A significant 
improvement in decoded BER was obtained for Scheme II. For systems where 
block erasures are allowed, Scheme II is highly recommended. 
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Fig. 2 Outer channel model 




























Performance of Example 3.2 (simulation) with 
16-state, rate = 5/6 PTVTC as inner code. 


Fig. 5.5 








Fig. 5.8 E^/Nq required to achieve P^ = 10 and 10 vs. 

for Example 3.2 with 16-state PTVTCs as inner codes (simulation) 





















Table 1. Coding gain over QPSK. of Example 3.4 
with = 5/6 coded 8PSK as inner code. 


# of inner 
code states 

R e ff, bits per 
channel use 

Coding gain at 10"6 
(Eb/No)dB, 1CT 6 

Coding gain at 10“ 9 
(Eb/N 0 )dB, 10-9 

2 

1 

2.85 

5.08 

4 

1 

5.07 

7.13 

8 

1 

3.65 

6.28 

16 

1 

4.15 

6.35 



Table 2. Coding 
with R^ = 3/4 

gain over QPSK 
coded 16PSK as 

of Example 3.4 
inner code. 

# of inner 
code states 

R e ff, bits per 
channel use 

Coding gain 
(E b /N 0 )dB : 

at 10“ 6 Coding gain at 10“ 9 

, 10-6 (E b /N 0 )dB , 10-9 

2 

1 

2.05 

4.18 

4 

1 

3.60 

5.77 

8 

1 

3.22 

5.45 

16 

1 

3.22 

5.47 






Fig. 8.2 Code performance of Example 3.5 (formula calculation) 
with = A/5 self-orthogonal convolutional codes as 

inner codes. 


Y dB 



Fig. 9 Asympototic concatenated coding gain without 
demodulator output quantization and with 
R^ = (n-l)/n punctured codes formed from 

(.2,1,6) convolutional code and RS code of 
length N = 255. 
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Fig. 11 Asymptotic concatenated coding gain of Example 3.3 
with Ungerboeck's = 2/3 coded 8PSK as inner 

codes and N = 255 RS outer codes. 




Fig. 12.1 Asymptotic concatenated coding gain of Example 3.4 
with = 5/6 coded 8PSK as inner code and N = 255 

RS outer codes. 
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Fig. 12,2 Asymptotic cone 
with R^ = 3/4 c 
RS outer codes. 
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Fig. 14.1 Code performance of Example 5.1 (simulation) with 

= 3/4 punctured inner convolutional code, and B=4, 

T'=0.1, T =5, d 0 =33, R=0.656. (1) E. /N n =3.68 dB 

es 2 b U 

(Pb=7.9xl0“7 in scheme 1); (2) E^/Nq= 3.88 dB (P fa = 
2.7x10 ^ in scheme 1). 
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Fig. 14.2 Code performance of Example 5.1 (simulation) with 
R^=5/6 punctured inner convolutional code and B=4, 

T’=0.2, T =5, d =33, R=0.729. (1) E, /N n =4 . 56 dB 

es 2 bu 

(P, =6.5x10“^ in scheme 1); (2) E,/N =4.73 dB 
b b 0 

(P, =4.2x10 in scheme 1). 
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Fig. 14.3 Code performance of Example 5.1 (simulation) with 
R^=7/8 punctured inner convolutional code and B=4, 

T ' =0 . 2 , T es =6, d 2 =33. R=0.765. (1) E b /N Q =5.20 dB 

(P 1 .=2.2xlO _6 in scheme 1); (2) E,/N n =5.35 dB (P u = 

D g DU D 

1.3x10 in scheme 1). 
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Pig. 15.1 Code performance of Example 5.2 (simulation) with 
16-state R 1 =7/9 PTVTC 8PSK as inner code and B=7, 

T'=0.2, T es =10, d 2 =37, R eff =l- (1) E b /N Q =6.1 dB 

(P^=2.5xl0 ^ in scheme 1); (2) E b /NQ=6.34 dB (P^ = 
8.5x10 ^ in scheme 1). 
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Fig. 15.2 Code performance of Example 5.2 (simulation) with 
16-state R^=5/6 PTVTC 8PSK as inner code and B=5, 

T'=0.1, T es =8, d 2 =52, R eff =l. (1) E b /N 0 =6.53 dB 

(P b = ^»2xl0 - ^ in scheme 1); (2) E b /Ng=6.77 dB 

(P =1.9x10 ^ i n scheme 1). 
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Fig. 15.3 Code performance of Example 5.2 (simulation) with 
16-state R^=8/9 PTVTC 8PSK as inner code and B=8, 

T*=0.1, T es =9, d 2 =64, R eff =l. (1) E b /N 0 =7.48 dB 

(P b =4.3xl0 -6 in scheme 1); (2) E b /N Q =7.68 dB 
(P =5.8x10 ^ in scheme 1). 
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Fig. 1G Code performance of Example 5.3 (simulation) with 
16-state R^=2/3 coded 8PSK inner code, and B=4, 

T'=0.3, T =10, d.,=26, R . =0.9. (1) E,/N =5.07 dB 
’ es 2 eff b 0 

(P b =l. 11x10 ^ in scheme 1); (2) E t/NQ=5.45 dB 

(P =5.3x10 ^ in scheme 1). 




